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DETAILED ACTION 

1 . Claims 1 5-34 are pending in the application. 

Continued Examination Under 3 7 CFR 1.114. 

2 A request for continued examination under 37 CFR 1.1 14, including the fee set 
forth in 37 CFR 1.17(e), was filed in this application after final rejection. Since this 
application is eligible for continued examination under 37 CFR 1.114, and the fee set 
forth in 37 CFR1 .17(e) has been timely paid, the finality of the previous Office action 
has been withdrawn pursuant to 37 CFR 1.1 14. Applicant's submission filed on 
01/27/2009 has been entered. 

Priority 

3. Acknowledgement is made of application's claim for foreign priority under 35 
U.S.C. 1 1 9 (a)-(d) based on the Germany patent application No.1 0301 898.0 filed on 
01/17/2003 

Drawings 

4. The drawings are filed on 07/18/2005 are accepted for examination. 
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Claim Rejections - 35 USC §103 

The following is a quotation of the 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained thought the invention is not identically disclosed or described as set forth in section 102 
of this title, if the difference between the subject matter sought to be patented and the prior art are such that the subject 
matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill in the art 
to which said subject matter pertains. Patentability shall not be negatived by the manner in which the invention was made 

4. Claims 15-34 are rejected under 35 U.S.C 103 as being unpatentable over Szeliski, 
Richard (hereafter Szeliski) WO 0078038 A1 published on December 21, 2000, in view of Lin; 
Qian (hereafter Li), US Patent No US 5812286 A published on Sep.22, 1998. 

As to claim 15, Szeliski teaches A method for adjusting a characteristic curve of 
exposure sensitivity (Abstract, A system and method for manipulating a set of images of a 
static scene captured at different exposures to yield a composite image with improved 
uniformity in exposure and tone. The cumulative distribution function is then used to 
determine new pixel brightness levels for use in generating the composite image. The 
characteristic curve corresponds to the cumulative distribution function curve (see 
Fig.8A)) of at least one pixel of at least one image sensor (Abstract: desired composite 
image can be produced by summing the pixel brightness levels across the multiple 
images captured by adjusting the up and down exposure sensors of the camera 55. The 
image sensor corresponds to the exposure sensors of the camera), in a motor vehicle, the 
characteristic curve being formed in segments of functions (Abstract: histogram equalization 
involves creating a count of the number of pixels sets having the same summed 
brightness level. From this count, a cumulative distribution function is computed. Thus 
the cumulative distribution function is a piecewise continuous (segmented) functions) the 
method comprising: 
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adjusting the characteristic curve of the exposure sensitivity as a function of image 
signals (page 13 lines 8-18; histogram equalization is a process for mapping pixel 
brightness values of an image to approximate a uniform distribution. Thus, distribution 
function is adjusted based on the image signal produced by the camera 26) from at least a 
part of the scene registered (Figs. 1A-IC: FIGS. 1A through 1C are images depicting an 
office scene captured at different exposure settings) by the at least one image sensor 
(page 8 lines 8-18, a camera 55 capable of capturing a sequence of images 56 with 
different exposures by adjusting its the up and down the exposure sensors. The image 
sensor corresponds to the up and down exposure sensors of the Kodak DCS-488 camera 
(see page 1 line 25) so that the following is satisfied: 

the gray value density (Fig. 9A, the slope of the characteristic curve) of at least a part 
of the histogram of image signals from the at least one image sensor of the at least one part of 
the registered scene is approximately constant (Fig. 9A. page 3 lines 5-10, the slope of the 
characteristic curve is approximately. It is well known that the aim of histogram 
equalization is that obtaining an equally-gray value distribution density. In mathematic 
terms the density is the slope of the cumulative distribution function. Therefore, the 
derivative of the cumulative distribution function (CDF) gives the probability density 
function (PDF) or the gray value density function of the histogram. Therefore, the gray 
value- density corresponds to the slope of the cumulative distribution function (CDF). In 
addition the slope of CDF graph (see Fig. 8B) is approximately constant since the graph 
is approximately linear. Therefore, the gray value density is also approximately constant). 

However it is noted that Szeliski does not specifically teach "a frequency of the gray 
values which is a number of pixels within an image that have the gray values based on a total 
number of pixels of at least a part of the histogram of image signals from the at least one image 
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sensor of the at least one part of the registered scene is approximately constant;" although 
Szeliski strongly suggests the histogram equalization involves creating a count of the 
number of pixels sets having the same summed brightness level (page 3 lines 5-18 and 
lines 28-22). If the images are black and white, the pixel gray level could be used. The 
frequency of the gray values corresponds to the number of pixels sets having the same 
summed brightness level), signals from the at least one image sensor(page 1 lines 21-25, 
the two stop up and down exposure sensors of the Kodak camera) of the at least one part 
of the registered scene (Fig. 1A-1C: FIGS. 1 A through 1C are images depicting an office 
scene captured at different exposure settings) is approximately constant (page 1 lines 10- 
11, The office scene captured at different exposure settings are static (constant) scene 
taken at different exposures); 

On the other hand the automatic color processing to correct hue shift and incorrect 
exposure of Lin teaches a frequency of the gray values which is a number of pixels within an 
image that have the gray values based on a total number of pixels of at least a part of the 
histogram of image signals from the at least one image sensor of the at least one part of the 
registered scene is approximately constant (Figs. 3-5,8, Fig. 4 illustrates histogram of a 
scanned image, Fig. 5 illustrates a cumulative gray level histogram of the scanned 
image, and Fig.8 illustrates the histogram of the corrected image shown in FIG. 5. 
Further both the histogram graph (Fig. 4) and the histogram of the corrected image graph 
(Fig.8) are plotted pixel count verse gray level . Further Fig. 4 and Fig. 8 contain linear 
curves with very gentle slope ( almost zero slope), and clearly the pixel count is 
approximately constant where the slope of the histogram graph is gentle) . 
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It would have been obvious to one of ordinary skill in the art the time of invention was 
made to incorporate the automatic color processing to correct hue shift and incorrect exposure 
of Lin into the system and process for improving the uniformity of the exposure and tone of a 
digital image, because both Szeliski and Lin are directed to color correction of digital display 
media such as digital camera and scanner based on histogram of the acquired image(Line: 
Abstract, Szeliski -.Abstract, page 3 lines 20-25). 

It would have been obvious to one of ordinary skill in the art to incorporate the teaching 
of automatically correcting based on the histogram of the acquired image, because that would 
have allowed user of Szeliski to correct hue shift and incorrect exposure in scanner and digital 
camera, more efficiently(Lin col. 1 lines 52-55). 

As to claim 16, Szeliski teaches the characteristic curve of the exposure sensitivity is 
adjusted as a function of image signals (page 14 lines 16-17, a cumulative distribution 
function is computed using the summed brightness histogram where the histogram 
function is obtained from the signal generated by the camera 56. The characteristic curve 
of the exposure sensitivity corresponds to the cumulative distribution function) from at 
least a part of the scene registered by the at least one image sensor (Fig. 1 A-IC, page 4 lines 
23-24, 1A through IC are images depicting an office scene captured at different exposure 
settings. The image sensor corresponds to the up and down exposure sensors of the 
Kodak DCS-488 camera (see page 1 line 25)), so that, when a gray value wedge having two 
segments with different gradients of the gray values is registered as the scene (Fig. 1 A-IC, 
page 4 lines 23-24, the office scene captured at different exposure settings have different 
gradients of the gray values) the at least one image sensor generates an image nearly free of 
apparent contours (Fig. 6, page 5 lines 8-1 1, FIG. 6 is a composite image produced from 
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the bracketed images(set of images of a static scene captured at different exposures) of 
the office scene of FIGS. 1 A through 1C that exhibits a more uniform exposure and tone 
than any of the bracket images. The image nearly free of apparent contours corresponds to 
the composite image Fig. 6). 

As to claim 17, Szeliski teaches the characteristic curve of the exposure sensitivity (Fig. 
9A, page 5 lines 23, the graph of a cumulative distribution function) is adjusted as a 
function of a determined optimal characteristic curve of the exposure sensitivity (Figs. 9A -9C 
page 5 lines 27-29, a blended cumulative distribution function FIG. 9C is produced by 
blending the cumulative distribution function FIG. 9A with the straight line function FIG. 
9B. The determined optimal characteristic curve of the exposure sensitivity corresponds to 
blended cumulative distribution function FIG. 9C), including a determined characteristic 
curve of the exposure sensitivity which is optimal according to information theory (Fig.lB, a 
straight line distribution function generates uniform distribution. Thus, theoretical 
distribution function optimal according to information theory corresponds to the straight line 
distribution function corresponds), at least one of the optimal characteristic curve of the 
exposure sensitivity (Fig. 9c) and the characteristic curve of the exposure sensitivity which is 
optimal according to information theory (Fig, 9B) being determined as a function of image 
signals (Figs. 9A-9C, the Figs. 9A through 9C are plotted as a function of image signal 
generated by the camera56) from the at least one image sensor (page 5 line 31 and page 6 
Mnes1-2, Fig. 18A is a composite image produced from the bracketed images of the office 
scene of FIGS. 1A through 1C using the up and down exposure sensors of the Kodak 
DCS-488 camera (see page 1 line 25).The image sensor corresponds to the up and down 
exposure sensors of the camera 56). 
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As to claims 18, Szeliski teaches determining the optimal characteristic curve of the 
exposure sensitivity as a function of a histogram of the gray values (page 13 lines 8-9, page 14 
lines 16-17, histogram equalization is a process for mapping pixel brightness values of 
an image to approximate a uniform distribution. A cumulative distribution function is 
computed using the summed brightness histogram to determine the uniform distribution. 
Further if the images are black and white, then the standard pixel gray levels would 
preferably be used as the measure of pixel brightness (see page 16 lines 26-28). The 
characteristic curve of the exposure sensitivity corresponds to the cumulative 
distribution function curve (Fig.9A), and the optimal characteristic curve of the exposure 
sensitivity corresponds to Fig. 9C and which is obtained by blending the cumulative 
distribution function Fig. 9A with the straight line function Fig. 1B (page 15 lines 24-25)of 
at least one image and/or of at least one image detail (Fig. 1A-1C: FIGS. 1A through 1C are 
images depicting an office scene captured at different exposure settings. Thus FIGS. 1A 
through 1C have different image detail, and the optimal (page 15 line 27-29)) 

approximating the characteristic curve of the exposure sensitivity (page 15 lines 24-25, 
blending the cumulative distribution function Fig. 9A with the straight line function Fig. 
9B) to the determined optimal characteristic curve of the exposure sensitivity (page 16 lines 4-6 
the blending process is carried out in order to determine the optimal cumulative 
distribution function (Fig.9C) that represent the composite image (Fig.lOB) having the best 
possible improvement in exposure and tone uniformity. The optimal characteristic curve of 
the exposure sensitivity corresponds to the blended cumulative distribution function Fig. 
9C), including approximation of the characteristic curve of the exposure sensitivity to the 
determined optional characteristic curve of the exposure sensitivity through at least one 
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numerical approximation method and/or at least one segmenting method (Fig. 7B shows the 
steps of obtaining the optimal cumulative distribution function using numerical 
approximation that includes Normalization, Curve fitting, Histogram Equalization, Partial 
Equalization). 

As to claim19, Szeliski teaches at least one of the gain (Fig. 9A, the slope the 
cumulative distribution function graph that measure the uniformity of an image), the 
offset, the integration time and at least one additional parameter (page 14 lines 16-17, the 
characteristic pixel value which is pixel brightness values of an image ) for adjusting the 
characteristic curve of the exposure sensitivity (page 14 lines 28-22, see also step 714, the 
pixel brightness values are adjuster in ordered to approximate the cumulative 
distribution function. The characteristic curve of the exposure sensitivity corresponds to 
the cumulative distribution function graph) of the at least one pixel of the at least one image 
sensor (the approximation is carried out by adjusting exposure and tone of the set of 
images (Figs. 1A-1C) captured at different exposure using the exposure sensors of the 
Kodak CDCS-488 camera (see page 1 line 25) is adjusted, the at least one additional 
parameter for adjusting the characteristic curve of the exposure sensitivity being at least one of 
(i) at least one parameter for adjusting the number of segments of the characteristic curve of the 
exposure sensitivity (Fig. 7B, adjusting the summed e brightness values of values of an 
image), (ii) at least one parameter for adjusting the position of the segments of the 
characteristic curve of the exposure sensitivity, (iii) at least one parameter for adjusting the size 
of the segments of the characteristic curve of the exposure sensitivity, and (iv) at least one 
parameter for adjusting the at least one function(page 15 lines 18-28, blend the normalized 
cumulative distribution function with a straight line function. The at least one function 
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corresponds to the linear function (Fig. 9B), at least one parameter corresponds to the 
pixel brightness values of an image that t is used to approximate a uniform distribution 
of cumulative distribution function (page 13 lines 9-10)) 

As to claim 20, Szeliski teaches at least one of the functions is a linear function (see 

Fig.9B). 

As to claim 21 , Szeliski teaches the characteristic curve of the exposure sensitivity of the 
at least one pixel of the at least one image sensor is adjusted as a function of image signals 
(page 13 lines 8-18, histogram equalization is a process for mapping pixel brightness 
values of an image to approximate a uniform distribution. Thus, distribution function is 
adjusted based on the image signal generated by camera 56) from at least two image 
sensors, including at least one stereo camera (page 1 lines 21-25, FIGS. 1A through 1C 
show three images of an office desk and window, taken at different exposures. 
Specifically, these images were captured with a Kodak DCS-40 camera, by adjusting the 
exposure up and down by two "stops". The two image sensors corresponds the Kodak up 
and down exposure sensors, and the stereo camera corresponds to the Kodak DCS-40 
camera). 

Regarding claims 22-27, all claimed limitation are set forth and rejected as per 
discussion for claims 15-21 . 

As to claim 28, Szeliski teaches A computer program executable on a computer (Fig. 2 
page 7 lines 5-18, and page 23 claim 13), comprising: 

a program code arrangement (page 23 claim 13); 
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Regarding the remaining section of claim 28, all claimed limitation are set forth and 
rejected as per discussion for claiml. 

Regarding claims 29-34, all claimed limitation are set forth and rejected as per 
discussion for claims'! 6-21 . 
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If attempt to reach the examiner by telephone are unsuccessful, the examiner's supervisor 
AHMED SAMIR can be reached on (571)272-7413. The fax phone number for the organization 
where the application or proceeding is assigned is 571-237-8300. Information regarding the 
status of an application may be obtained from the patent Application Information Retrieval 
(PAIR) system. Status information for published application may be obtained from either Private 
PAIR or Public PAIR. 

Status information for unpublished application is available through Privet PAIR only. 

For more information about the PAIR system, see http://pair-direct.uspto.gov. Should you have 
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Supervisory Patent Examiner, Art Unit 2624 
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